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REFERENCES 


I.  INTRODUCTION 


The  design  of  linear  minimum  me an-squa re-error  (MMSE)  estimation  filters 
(or  Wiener  filters)  for  stationary  signals  in  additive  stationary  noise 
requires  precise  knowledge  of  the  signal  and  noise  power  spectral  densities 
(PSD's).  In  practice,  however,  the  actual  signal  and  noise  may  differ  to  a 
certain  degree  from  these  nominal  densities.  This  can  lead  to  considerable 
degradation  in  the  performance  of  Wiener  filters. 

A  minimax  solution  to  th.s  problem  was  proposed  by  Poor  [1],  based  on  the 
work  of  Kassam  and  Lim  [2].  To  accommodate  for  the  uncertainty,  it  is  assumed 
that  the  spectral  densities  of  the  signal  and  noise  lie  in  some  general  classes 
of  possible  spectra.  A  filter,  termed  "robust",  is  then  designed  to  minimize 
the  mean-square-error  (MSE)  for  the  "worst-case"  pair  of  spectra  in  that 
class. 

For  many  uncertainty  spectral  classes  of  interest,  the  robust  filters 
are  not  physically  realizable.  Therefore,  the  purpose  of  this  thesis  is  to 
find  realizable  (finite-order)  filters  which  are  good  approximations  of  the 
ideal  robust  filters.  Tx^o  uncertainty  models  for  spectra  will  be  considered: 
the  e-contaminated  class  and  the  p-point  class.  We  will  approximate  the 
ideal  robust  filters  with  realizable  n-th  order  filters  composed  of  low-pass, 
high-pass, and  all-pass  Butterworth  or  Chebyshev  analog  filters.  We  will 
then  analyze  the  performance  of  those  filters  and  compare  it  to  that  of 
the  ideal  filters. 

From  the  classical  theory  of  Wiener  filtering,  the  MSE  associated 
with  estimating  a  signal  in  uncorrelated  additive  noise,  where  the  signal 
and  noise  are  zero-mean,  second-order,  wide-sense  stationary  random  processes 
is  given  by 


s(S,N,H)  =  /  [S(co)|l-H(u)r  +  N(u>)  H(w)  Jdu 


where  S(ai)  and  N(oj)  are  the  PSD's  of  the  signal  and  noise, respectively,  and 
H(uj)  is  the  transfer  function  of  the  filter.  For  a  given  signal  and  noise 
spectral  pair  (S^.N^) ,  the  Wiener  filter 

*  Vw) 

H0(U°  “  S0(u)+Nq(cj)  ( 


minimizes  the  MSE.  The  corresponding  minimum  MSE  is 
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Throughout  this  study,  we  will  be  considering  a  nominal  pair  of  spectral 
densities  Sq(oj)  and  Nq(oj)  to  be  the  original  pair  used  in  designing  the 
nominal  Wiener  filter.  Specifically,  we  will  assume  we  have  a  narrow-band. 


first-order  Markov  signal  in  wide-band, first-order  Markov  noise,  i.e.. 
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where  ag  and  a^  are  the  3  dB  bandwidths  and  vg  and  v^  are  the  total  powers 
of  the  signal  and  noise  processes, respectively.  The  corresponding  nominal 
Wiener  filter  (using  Equation  (2))  is  given  by 


3 


reasonable  to  assume  for  many  applications. 

As  we  mentioned  earlier,  it  has  been  shown  that  the  performance  of 

■k 

the  nominal  filter  becomes  unacceptable  when  the  signal  and  noise  PSD's 

vary  from  the  nominal  densities  given  by  (4. a)  and  (4.b)  (see  Vastola  [3]). 

A  more  realistic  approach  is  to  let  the  signal  and  noise  be  members  of  some 

uncertainty  classes  of  spectra  J  and  V..  The  robust  filter  H  is  a  solution 

R 

to 


- 

min  sup  e(S,N,H)  (6) 

H  [  (S,N)€  Vx  ?? 


i.e.,  it  is  the  Wiener  filter  for  the  pair  of  spectra  that  has  the  maximum 
MSE  over  that  class.  In  this  sense,  the  robust  filter  gives  the  smallest 
upper  bound  on  the  MSE  over  the  classes  J  and  ??.  Thus,  it  guarantees  a 
certain  level  of  performance. 

Since  robust  filters  are  derived  without  the  constraints  of  physical 
realizability,  it  is  our  objective  to  find  realizable  n-th  order  filters 
such  that,  as  the  order  n  increases,  their  performances  approach  that  of 
the  ideal  robust  filters.  In  Chapters  II  and  III,  we  will  consider  robust 
filters  for  two  uncertainty  classes  of  spectra:  the  e-contaminated  class 
and  the  p-point  class.  For  each  class,  we  will  approximate  the  ideal  robust 
filter  transfer  function  with  Butterworth  or  Chebyshev  filters  (which  are 


rational  functions)  and  evaluate  SUP  e(S,N,H  ),  where  H  is  the 

(S,N)€  J  *  71  n  n 

n-th  order  approximate  robust  filter.  We  will  compare  the  worst-case 

performance  of  H  to  that  of  the  ideal  robust  filter  and  the  nominal 
n  R 

filter  H^1. 

In  our  numerical  results,  performance  will  be  measured  in  terms  of 
output  SNR  versus  input  SNR.  The  output  SNR  will  be  taken  to  be  the  signal 
power  divided  by  the  MSE,  i.e.. 


output  SNR 


e(S,N,H) 


By  definition,  the  J1SE  is  E{[S(t)  -  S(t)]  },  where  S(t)  is  the  actual  signal 
and  S(t)  its  estimate  (or  output  of  the  filter).  Since  S(t)  can  be  written 

A  A 

as  S(t)  +  (S(t)-S(t)),  the  error  term  S(t)  -  S(t)  is  considered  as  the  noise 
at  the  output. 


II.  THE  e-CONTAMINATED  CLASS 


A.  Definition 

The  e-con tamina ted  classes  of  possible  signal  and  noise  PSD's  are  defined 
by 

J  -  (S(oj) /S(oj)  =  (l-e)S  (to)  +  eS'(o)),co  €  ]R  }  (8. a) 

and 

71  =  N(oj)/N(oj)  =  (l-e)N  (to)  +  eN '  (oj)  ,w  €  r}  (8.b) 

e  0 

where  e  is  a  measure  of  uncertainty,  0  1  e  1  1’  s0(w)  and  are  the  nominal 

PSD's,and  S'(oj)  and  N'(u>)  are  any  contaminating  PSD's  such  that 

00  00 

/  S'(<jj)du)  =  j  SQ(u))du)  =  2nvg  (9. a) 

—  OO  —CO 

and 

00  OO 

/  N'(w)du)  =  j  N^CuOdw  =  2ttv^  (9.b) 

—  OO  —00 

This  model  is  reasonable  for  describing  classes  of  possible  PSD's  which 
deviate  to  a  certain  extent  from  the  nominal  PSD's,  subject  to  the  total  power 
being  a  constant.  This  general  type  of  classes  has  been  studied  as  uncertainty 
models  in  a  number  of  situations  (see  [ 2] , ] , [ 5] , [ 6] ) . 

B .  Robust  Filters  for  the  e-Contaminated  Class 

1 .  The  ideal  robust  filter 

As  discussed  in  the  introduction,  a  most  robust  filter  as  defined  by 
Poor  [1]  is  a  solution  to  the  minimax  problem  in  (6).  Its  design  can  be 
shown  to  be  reduced  to  the  problem  of  finding  "least-favorable"  pairs  of 

spectra  S.  and  N  for  which  the  minimum  MSE  is  maximum  in  the  classes  J  and 

L  L 

Then,  the  robust  filter  is  simply  the  Wiener  filter  for  the  pair  (SL>N  ),  i.e., 


It  is  possible  to  draw  an  analogy  between  least-favorable  pairs  of  spectra 


and  least-favorable  pairs  of  probability  density  functions  (PDF's)  in  robust 

hypothesis  testing  (see  Poor  [1]).  Since  least-favorable  pairs  of  PDF’s  have 

been  derived  for  several  classes  of  PDF's  (see  [4 ] , [7 ] , [8] ) ,  this  analogy  can 

be  used  to  determine  S  (w)  and  N  (w)  (and  hence  the  robust  filter  H  given 

L  L  K 

in  (10))  for  analogous  classes  of  PSD's.  For  example,  by  applying  the  results 

of  Poor  [1]  and  using  the  expression  for  least-favorable  PDF's  for  the 

e-contaminated  class  given  by  Huber[4],  Vastola  [3]  has  shown  that  the  robust 

filter  for  the  classes  J  and  71  is 

e  e 


Hr(u)  =  /  HQ(u) 


.  C,r 

Ir  g  _ 

1  c  r+1 


k 

k2  c2r+l 


for  Hq (m)  £  kl 


for  k1  <  HQ(u))  <  k2 


for  Hq(w)  >  k2 


The  constants  c^  and  c?,  0  £  c^  <  c2  £  =°,  are  determined  by  solving  the 
following  equations  (see  Huber  [4]  and  Poor  [1]): 


(1-E)  /  Nn(w)dw  +  -i-  /  sn(w)dw]=  1 

L  A2  2  A2  J 

(1-e)  /  S  (u)dw  +  c  /  N  (w)dw  =  1 

L  A  1  A  U 

L  1  A1 


(12. a) 


(12. b) 


where  the  sets  and  A 2  are  defined  as  follows: 


sn(w) 

A,  =  { to  €  ]R  — —  <  c.r} 


(13. a) 


E 
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For  the  nominal  PSD's  SQ(to)  and  NQ(<o)  given  in  (4. a)  and  (4.b),  Equations 
(12. a)  and  (12. b)  become 


(14 .a) 


where 


(14. b) 


(15) 


are  the  frequencies  at  which  H^(oj^)  =  k^,  i=l,2.  For  a  given  £»  0  _<  e  _<  1,  the 

above  equations  are  solved  by  iteration  for  c^  and  c In  particular,  for 

the  values  of  e  we  will  consider,  we  have:  for  e  =  0.1,  c^  *  0.125  and  c^  *  8; 

for  e  =  0.25,  c^  =  1/2.8  =  0.357,and  c^  =  2.8. 

Figure  1  illustrates  the  general  frequency  response  of  the  ideal  robust 

* 

filter  H  ,  given  the  nominal  filter  H  .  Note  that  only  the  portions  of  H  (to) 

K  U  K 

*  * 
and  Hq(w)  for  positive  frequencies  to  are  shown,  since  H^to)  and  Hg(to)  are  both 

symmetric  with  respect  to  the  to  =  0  axis. 

2,  The  approximate  robust  filter 

To  approximate  the  ideal  robust  filter  transfer  function  shown  in 
Fig.  1,  we  will  use  analog  Butterworth  filters.  These  filters  can  be  physically 
realized  with  an  active  network  (see  Van  Valkenburg  [9]).  A  low-pass  n-th 
order  Butterworth  filter  is  characterized  by  the  square  of  the  magnitude  of  its 
frequency  response, 


1 

l+(to/to  ) 
c 


2n 


(16) 


9 


where  uj  is  the  3  dB  cutoff  frequency.  The  actual  transfer  function  of  a 
c 

low-pass  Butterworth  filter  can  be  determined  by 


where  the  polynomials  B^(s)  of  degrees  n  =  1,2,.. .,10  are  tabulated  Butterworth 
polynomials  (see  [9]).  Figure  2  shows  the  magnitude  squared  response  !Hgn(w)!^ 
of  low-pass  Butterworth  filters  for  several  orders  n  and  0^*1.  It  can  be  seen 
that,  as  the  order  n  increases,  the  response  approaches  that  of  the  ideal 
low-pass  filter. 

The  ideal  robust  filter  as  given  by  (11)  is  a  non  causal  filter.  On  the 
other  hand,  Butterworth  filters  are  causal.  Therefore,  in  order  to  have  an 
adequate  comparison  between  the  ideal  and  approximate  robust  filters,  we  will 
use,  as  non  causal  filters,  the  magnitude  squared  response  of  the  Butterworth 

2 

filters  in  our  approximation.  It  should  be  noted  that  these  filters  lHBn(w)| 
can  be  implemented  (although  not  in  real-time)  by  signal  processing  techniques 
(see  Appendix  A) . 

From  the  expression  of  the  ideal  robust  filter  (Eq.  (11))  and  Fig.  1,  it 


is  clear  that  we  can  approximate  the  transfer  function  of  the  ideal  robust 

filter  with  three  sections:  the  first  section  is  realized  by  a  low-pass 

filter  with  gain  an^  cutoff  the  last  section  by  a  high-pass  filter 

with  gain  and  cutoff  oj^,and  the  middle  section  by  the  product  of  the  nominal 
* 

filter  Hq(w)  and  a  bandpass  filter  of  unit  gain  and  bandwidth  The 

sum  of  those  three  sections  constitutes  the  approximate  robust  filter 


transfer  function  H  (w) ,  which  is  shown  in  Fig.  3.  The  filters  H  (w)  and 

n  L*lr  ^ 

(oj)  represent  the  magnitude  squared  of  low-pass  Butterworth  filters  with 
cutoffs  gu^  and  respectively,  i.e.. 


Magnitude  squared  response  of  n-th  order  low-pass  Butterworth  filters 


«LP2<“>  - 


l+Cui/u^) 


l+Coi/di^)  * 


The  difference  (H^p  (to)  -  H^p  (m) )  is  used  to  obtain  the  bandpass  filter  of 

bandwidth  in  the  middle  section.  The  filter  H  (w)  represents  the 

c.  J-  HP 

magnitude  squared  of  a  high-pass  Butterworth  filter  with  cutoff  ,  i.e.. 


"hp<“>  - 


l+(w^/u>)‘ 


From  Fig.  3,  we  see  that  the  resulting  approximate  robust  filter  for  the 
e-contaminated  class  is  given  by 

Hn(co)  =  k2HLp  (to)  +  kjHgpCw)  +  H*(u)[HLp  (to)  -  (u)  ]  (2 

■k 

where  H^(m)  is  the  nominal  filter  in  (5). 

C.  Worst-Case  Performance  Evaluation 


In  this  section,  our  goal  is  to  evaluate  the  worst-case  performances 
* 

of  the  nominal  filter  Hn ,  the  ideal  robust  filter  H  and  its  approximation  H  , 

U  K’  n 

proposed  in  the  previous  section.  Performance  will  be  measured  by  the  output 
SNR  as  defined  in  the  Introduction  by  Eq.  (7).  In  the  worst-case,  we  will 
look  at  the  maximum  MSE  over  all  possible  spectra  in  the  relevant  e-contaminated 
class. 


Using  the  general  expression  of  the  MSE  (Eq.  (1))  for  a  given  pair  of 
spectra  (S,N)  in  the  e-contaminated  class  J ^  (E1s*  (8  .a)  ,  (8.b) )  ,  and  a 

given  filter  H,  it  is  straightforward  to  show  that 


13 


e(S,N,H)  -  (l-e)e(S0,N0,H)  +  ee(S',N\H) 


We  observe  that  the  MSE  expression  in  (22)  is  analogous  to  the  expression  for 
the  e-con tamina ted  spectra,  in  the  way  the  uncertainty  is  modeled.  Indeed, 
the  term  e(S',N',H),  which  is  the  MSE  associated  with  the  contaminating  PSD's 
S'  and  N',  is  not  known  since  the  only  information  about  S'  and  N'  is  their 
total  powers.  However,  we  can  obtain  an  upper  bound  on  e(S',N’,H)  using 
this  information,  i.e., 

00 

-o'.N'.H)  =  ~  j  [S'(w)  j  l-H(co)  |  2  +  N'(m)  |H(m)  |2]dm 
•  00 

1  <  /  S '  (<jj)da)jmax  Jl-H(u))|2+|  /  N,((jj)dul  max|H(u))|2> 

“L-oo  J  OJ  L  -CO  J  (jj  J 

2  2  2  2 

-  vs  max |  l-H(uj)  |  +  vN  max|H(u)|  (23) 

U)  U) 

The  last  step  is  true  from  Eqs.  (9. a)  and  (9.b). 

In  fact  e(S',N',H)  can  be  arbitrarily  close  to  the  bound  in  (23). 
Therefore,  (23)  is  the  least  upper  bound  and  so  the  worst-case  performance 
for  H  is 


^su|>  e(S,N,H)  =  (l-e)e(S0,N&,H)+ e  sup  e(S' ,N' ,H) 


=  (l-e)e(SQ,N0,H)+ejv2  maxjl-H(u)  |2+v2  max|H(ai)  |21  (24) 

j.  u  u  J 


To  obtain  the  worst-case  output  SNR, we  simply  divide  through  Eq.  (24)  by 
2 

the  signal  power  v  and  then  take  the  inverse  of  the  result.  In  this  way 

J 

2  * 

we  can  derive  the  expressions  for  sup  e(S,N,H)/v„  for  H_,  H  and  H  ; 

j  x  n  s  0  R  n 

£  £ 

2  2 

These  will  be  in  terms  of  the  input  SNR  r  =  v  /vM. 

D  IN 

1.  Nominal  filter 

: k 

For  the  nominal  filter  H^,  we  have  (from  Eq.  (3)) 


^wv  i  r  * 

- 2 -  =  - 2  /  Hq (cii)Nq  (m)dca 

v„  2irv„  -oo 


Using  the  nominal  filter  transfer  function  Hg(m)  given  in  Eq.  (5)  and  the 
nominal  PSD  of  the  noise  in  Eq.  (4.b),  this  reduces  to 


e(VW  2 


0  <Vs)(VV,+<Vasr)" 


as*s  1 

.<W)(W>  J 


Since  Hq(w)  is  a  real,  positive  function  of  u>,  we  also  have 


i  *  1 2  r  *  1 2 

|H„(co)  |  =|  max  H„(w) 
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max  |l-H0(a))|2 
0) 


nax(l- 


an  +  V 


Therefore,  using  Eq.  (24)  for  the  nominal  filter  and  the  results  in  Eqs .  (26), 
(27),  and  (28),  we  obtain 


sup  e (S,N,H  ) 

*  n„ 

£  t. 


(l-e) 


(aN+aSr)(aS+aNr) 


(Wj  x) 


2.  Ideal  robust  filter 

From  the  general  expression  for  the  maximum  MSE  for  the  classes  J 
and  71^  given  by  Eq.  (24)  and  the  ideal  robust  filter  transfer  function 
(see  Eq.  (11)  and  Fig.  1),  we  observe  that  the  ideal  robust  filter  H 

K 

improves  on  the  worst-case  performance  (in  comparison  to  the  nominal  filter 

Hq)  by  decreasing  the  factors  max|H(u>)|  and  max |  l-H(oj)  |  in  the  worst-case 

* 

MSE.  This  is  achieved  by  reducing  the  high  gain  of  to  a  constant  level 

* 

over  the  low  frequency  range  [O,^]*  and  increasing  the  low  gain  of  to 
a  constant  level  over  the  high  frequency  range  [w^,®).  The  constants 
k^  and  k^  and  the  cutoff  frequencies  and  u)^  depend  on  the  degree  of  the 
uncertainty  e  (see  Eqs.  (11)  ,  (12 .a)  ,  (12 .b)  ,  (14 .a) , (14 .b ),  and  (15)). 

To  evaluate  the  maximum  MSE  given  in  (24)  for  the  ideal  robust  filter  H  , 
we  first  need  to  look  at  the  nominal  performance  of  H  .  We  will  break  up 

K 

2 

e(S_,N  ,H  )/v  into  three  integral  terms  corresponding  to  the  three  sections 
U  U  R  S 

constituting  the  ideal  robust  filter,  i.e.. 


16 


e(VW 


| — —  =  -^2  /  [S0(u)|1-Hr(U)|2  +  N0(a»)  |Hr(«)  |  ]du 


TVS  ° 


=  nsr^  +  nsr^  +  nsr^ 


(30) 


where 


nsr^  =  — /  2CSq(oj)  (l-^) 


dw 


*VS  ° 


(31) 


and 


nsr. 


A  1 


-^2  /~1[SQ(u>)  |l-H*(u>)  |2  +  N0(«o)|H*(u»)|Z]da) 


*,  .  i2. 


ffVS  u2 


1  ★ 

-  -±2  /  H0(cj)Nq (aj)du) 


UVS  “2 


nsr3  =  -ij  /  [S0(U)(l-k1)i  +  N0(^)k3]da, 


“l 


(32) 


(33) 


For  the  nominal  pair  of  PSD's  (Sq,Nq)  given  in  (4. a)  and  (4.b),  and  the 
corresponding  nominal  filter  given  in  (5),  these  integrals  become 


nsr,  =  — 

1  IT 


nsr. 


2  -1  ^2  1  2  -1  w2 

(1-k  )  tan  —  +  -  k  tan  — 

2  as  r  z  aN 


where 


and 


\ 

“ 

-1 

W1 

-1  ^2 

f) 

tan 

b 

tan  — 
b 

_ 

- 

b  & 


nsr. 


(  vv\ 
¥sU+*sV 


f  [a-V2  (I*  t“"1  J)  +fk: 


1 

TT  _  1  1 

—  -  tan  — 
L  aN 


(34) 


(35) 


(36) 


(37) 


On  the  other  hand,  we  have 


max 

03 


iHj^w)  I2  =  k2 


and 


max  |l-HR(o))|2  =  (1-k.^2 


Therefore,  using  Eqs.  (24),  (30),  (34)-(39),  the  worst-case 
the  ideal  robust  filter  can  be  determined  from 


sup  e(S,N,H  ) 
^  R 

e  e 


=  < (1-e) 


«[(1- 


2  -12  12 
k»)  tan  —  +  —  k„tan 

2  as  r  2 


as4a 


/  -1W1  ^  -1 
—  |  tan  — —  tan 

N  \  b 


+  (l-k1>2  {  j  -  tan 


/  I  „  tan'l  JA 

K2  >s) 

hi-  j  )i 


+  £ 


[(1V  +  7k2_ 


For  a  given  e,  the  worst-case  output  SNR 


sup  e(S,N,H  ) 

J  x  71  R 

£  £ 


of  the  parameters  03^.  k^,  b,and  r.  We  note  that  oj^ 


(given  e)  but  k. ,  k  ,and  b  are  functions  of  the  input  SNR  r, 


(38 

(39 

performance  of 

032 

■) 

(40 

is  a  function 

and  03 2  are  fixed 


ioc*>:<inr 


and  the  maxima  of  |l-H^(u))|‘1  and  J  ( to )  |  ^  are  computed  numerically,  given  the 
degree  of  uncertainty  e,  the  order  n,and  the  input  SNR  r.  In  our  numerical 
results,  we  have  taken  the  nominal  signal  and  noise  bandwidths  to  be 
a„  =  1  and  a.,  =  1000  respectively. 

Figures  4  and  5  illustrate  the  worst-case  performances  of  the  nominal 
* 

filter  Hg,  and  the  ideal  and  approximate  robust  filters  and  (n  =  2), 
expressed  in  terms  of  the  worst-case  output  SNR  versus  the  input  SNR,  for 
e  =  0.25  and  0.1, respectively.  Both  SNR's  are  translated  into  dB,  i.e.. 


input  SNR  =  10  log.^  ~ 


"worst-case"  output  SNR  =  10  log,n  [  v^  / sup  e(S,N,H)  ) 

10  V  SA  ><  \  ) 


=  -10  log  ~  /  sup  e (S 


» N ,  H  )  / ' 


v?  \ 


Contaminated  class  (e=0.1),  Butterworth  approximation.  (From  t 
ne)  Worst-case  performances  of  ideal  robust  filter  H  ,  approximat 
d  nominal  filter  H*  (solid  line  is  for  trivial  filtering,)  . 


2  * 

The  ratio  sup  e(S,N,H)/v  is  given  by  Eqs.  (29),  (40)  and  (41)  for  H-, 
j  x  =>  o 

e  e 

and  H^,  respectively.  The  solid  line  in  Figs.  4  and  5  gives  a  lower  bound 

on  the  output  SNR:  it  represents  what  we  can  do  trivially  for  any  pair  of 

spectra  by  using  a  no-pass  filter  (H  =  0)  for  negative  input  SNR's  and  an 

all-pass  filter  (H  =  1)  for  positive  input  SNR's.  The  middle  and  upper  lines 

give  the  worst-case  performances  of  the  ideal  and  approximate  robust  filters 

H  and  H  (n  =  2),  respectively.  The  bottom  line  gives  the  worst-case 
k  n 

* 

performance  of  the  nominal  filter  H^.  We  observe  that,  except  for  a  small 

range  of  input  SNR  around  0  dB ,  the  nominal  filter  does  significantly  worse 

than  trivial  filtering  and  even  for  values  of  the  input  SNR  near  0  dB,  it  still 

does  worse  than  both  ideal  and  approximate  robust  filters.  From  our  numerical 

results,  we  found  that  the  worst-case  performances  of  the  approximate  robust 

filters  Hr (tu)  for  n  =  2  to  10  improve  only  slightly  with  increased  order  n. 

Thus,  we  have  only  shown  the  performance  of  ^(m)  in  our  figures,  since  the 

difference  between  H  (m)  and  H  (m)  for  higher  n  would  be  almost  indistinguish- 

2  n 

able.  However,  we  can  see  from  Figs.  4  and  5  that  even  ^(w)  has  a  performance 

that  is  sufficiently  close  to  the  ideal  robust  filter  for  both  values  of  e 

considered  (less  than  0.2  dB  difference). 

We  also  note  that  for  e  =  0.1  (10%  uncertainty),  performance  is  better 
* 

for  all  filters  (H^ ,  HR,and  Hn)  than  for  e  =  0.25  (25%  uncertainty),  which  is 
to  be  expected  since  with  less  uncertainty,  the  e-contaminated  spectra  are 
closer  to  the  nominal  spectra. 

The  general  conclusion  we  can  draw  from  these  results  is  that,  using  only 
simple  Butterworth  filters  of  low  order  (n  =  2),  we  have  been  able  to  obtain  a 
very  good  approximation  of  the  ideal  robust  filter  in  terms  of  worst-case 
performance  over  the  e-contaminated  classes  of  spectra. 


III.  THE  p-POINT  CLASS 


A.  Definition 

For  this  uncertainty  class,  we  assume  that  the  only  information  we  have 

2  2 

about  the  PSD's  of  the  signal  and  noise  is  their  total  powers  v  and  v  ,  and 

S  IN 

that  we  can  estimate  the  fraction  of  these  powers  in  some  bands  of  the  fre¬ 
quency  domain.  Formally,  the  p-point  spectral  classes  have  been  defined  in 
Cimini  and  Kassam  [10]  by 

Vp  =  { S (oo) /  ^  fb^  S(ai)doj  =  PSjvg  j=l>2 . m}  (44. 

and 

,  b.  „ 

U p  “  {N(o>) /  —  /bJ  N(uj)da)  =  PNjvN  j=l,2, . . . ,m}  (44. 


where  bQ,b1,...,bm  are  m+1  breakpoints  on  the  frequency  axis  with  bg  =  0, 

mm 

b  =  ®,and  0  ^p  ,  PM-  £  1  are  such  that  l  p„.  *  £  p  *  l,and  we 

m  ‘’J  j  _1  ^1  j  NJ 

assume  S (to)  and  N(w)  are  symmetric  about  the  cu=0  axis.  In  this  definition, 

2  2 

the  breakpoints  b^  and  the  fractional  powers  p<„  v^  and  p^  v^  are  assumed 
known.  Such  a  model  is  reasonable  because  it  is  possible  to  measure  the 
fractional  powers  of  a  process. 


A  simple  example  of  a  p-point  class  that  has  been  considered  by  Vastola 


[3]  is  one  with  three  breakpoints  (m=2) ,  where  bg  =  0,  b^  =  1  and  =  +00. 
B.  Robust  Filters  for  the  p-Point  Class 


1.  The  ideal  robust  filter 

By  expressing  the  ideal  robust  filter  HR(w)  in  terms  of  the  least- 
favorable  pair  of  PSD's  S  (oj)  and  NT  (w)  (see  Eq.  (10))  for  the  p-point 

Lj  Lt 

spectral  class,  Cimini  and  Kassam  have  shown  that  HR(w)  is  a  piecewise  con¬ 
stant  filter  given  by 


with  H^(w)  symmetric  about  the  w=0  axis.  For  the  special  case  of  m-2  and 
=  0,  b^  =  1,  =  +°°,  considered  by  Vastola  [3]  ,  the  ideal  robust  filter 

is  simply 


V“> 


psi  vs 


PS1  Vs  +  PN1  Vs 


(1-psi)vs 


2  -  Krl  ,  0)  e  [o,  1) 

2 


(46) 


(i_psi)vs  +  (i-pN1)vN 


j  =  Kr2  ,  u  6  [  1,  «) 


and  is  shown  in  Fig.  6. 

In  this  study,  we  will  slightly  modify  the  above  special  case  by  intro¬ 
ducing  a  small  intermediate  region  around  u>=l.  In  particular,  the  p-point 
class  we  will  consider  has  four  breakpoints  (m=3)  at  b^  =  0,  b^  =  1-a, 
b2  =  l+a,and  b^  =  +°°,  where  the  parameter  a,  0  <_  a  £  0.4,  will  be  chosen  to 
optimize  the  output  SNR  for  the  approximate  robust  filter  Hn  for  a  given 
order  n  and  a  given  input  SNR.  The  corresponding  ideal  robust  filter  Hr(io) 
is  shown  in  Fig.  7  where  the  gains  ,  j=l,2,3,  are  given  by  Eq.  (45). 

Note  that  for  a=0,  this  filter  reduces  to  the  tn=2  case  with  b^  =  0,  b^  =  1,  and 
b2  =  -H». 

The  reasons  for  using  this  modification  lie  in  the  general  expression 
of  the  maximum  MSE  for  the  p-point  class  and  in  the  structure  of  the  approxi¬ 
mate  robust  filters  that  will  be  used.  A  more  detailed  explanation  is  given 


in  Appendix  B,  as  well  as  the  procedure  for  choosing  the  parameter  a. 


Frequency  o> 


To  approximate  the  ideal  robust  filter  shown  in  Fig.  7,  we  will  sum  up 


the  response  of  a  low-pass  filter  with  cutoff  wc  =  1  and  gain 

with  the  response  of  an  all-pass  filter  with  gain  K2  =  as  shown  in 

Fig.  8,  i.e.,  the  approximate  robust  filter  can  be  expressed  as 

Hn(w)  =  Kx  HLp(u)  +  K2  (47) 

The  low-pass  filter  with  unit  gain  H^p(u)  will  be  realized  using  either  an 
analog  Butterworth  or  Chebyshev  low-pass  filter.  A  brief  description  on 
analog  Butterworth  filters  was  given  in  Chapter  II,  Section  B.2.  Analog 
Chebyshev  filters  can  also  be  realized  with  an  active  network  (see  [9]). 

A  low-pass  n-th  order  Chebyshev  filter  has  equal  ripple  behavior  in  the  pass- 
band,  and  the  square  of  the  magnitude  of  its  frequency  response  is  given  by 


where 


lHCn<tt) 


2  2 

1  +  6  C  (u>) 
n 


Cn(w) 


cos  (n  cos  oj)  ,  I  w  |  <_  1 
cosh  (n  cosh  ^  w) ,  |w|  >  1 


(48) 


(49) 


is  known  as  the  Chebyshev  polynomial  of  the  first  kind  of  degree  n,  and  the 
peak-to-peak  ripple  y  in  dB  in  the  passband  is 

Y  -  10  log10  (1  +  e2)  (50) 

2 

The  minimum  and  maximum  values  of  the  ripple  are  1/(1  +  B  )  and  1,  respectively, 
and  the  number  of  half  cycles  in  the  passband  ripple  is  equal  to  the  order  n 
of  the  filter.  In  general,  the  magnitude  response  of  the  filters  with  even 


orders  n  at  ui=0  is  equal  to  the  minimum  value  of  the  ripple  while  that  of  the 


filters  with  odd  order  n  is  equal  to  the  maximum  value  of  the  ripple,  but  the 
response  for  all  filters  passes  through  the  same  point  at  the  edge  of  the 
passband  (i.e.,  at  ojc = 1)  which  corresponds  to  the  minimum  value  of  the  ripple. 
Figures  9(a),  9(b),  and  9(c)  illustrate  the  magnitude  squared  response  of  n-th 
order  low-pass  Chebyshev  filters  for  ripples  y  =  0.5,  1,  and  2  dB,  respectively 
We  observe  that,  for  a  given  order  n,  the  larger  the  ripple  y,  the  steeper 
the  rolloff  in  the  stopband.  This  effect  is  more  accentuated  for  small  values 
of  n.  Furthermore,  by  comparing  the  magnitude  squared  responses  of  low-pass 
Chebyshev  and  Butterworth  filters  (see  Figs.  9(a),  9(b),  9(c),  and  2),  we  see 
that,  in  general,  the  Chebyshev  response  has  steeper  rolloffs  in  the  stopband 
than  the  Butterworth  response,  and  for  orders  n  >_  4,  Chebyshev  filters  have 
larger  attenuations  near  the  cutoff  frequency  =  1  in  the  stopband.  However, 
like  Butterworth  filters,  they  are  rational  functions,  since  the  transfer 
function  of  a  low-pass  Chebyshev  filter  is 


HCn(w) 


1 

82n-1Q  (u>) 
n 


(51) 


where  Qn(w),  n  =  2,..., 10  are  tabulated  polynomials  of  degree  n  (see  Craig 
[11]).  The  procedure  for  finding  the  poles  of  the  above  transfer  function 
is  also  found  in  Van  Valkenburg  [9]. 

For  reasons  of  causality  (as  discussed  in  Chapter  II,  Section  B.2),  we 
will  actually  use  the  magnitude  squared  of  the  Butterworth  or  Chebyshev  low- 
pass  filters  in  our  approximation.  Therefore,  for  the  Butterworth  case, 
the  approximate  robust  filter  is 

H„<“)  '  +1C2B 


(52) 


Magnitude  squared  response  of  n-th  order  low-pass  Chebyshev  filters.  (Y=ldB) 


Magnitude  squared  response  of  the  n-th  order  low-pass  Chebyshev  filters  (y=2dB) 


where  ! H_  (u)  is  given  bv  Eq .  (16)  with  w  =  1  and  K..  „  =  K  ,  -  K  „, 

K^g  =  K  ^  to  match  the  ideal  robust  filter  gains.  For  the  Chebyshev  case, 
the  approximate  robust  filter  is 

V“>  •  Klc!HCr,<“)|2  +  K2C  <53 

2 

where  Jh^Ccj)!  is  given  by  Eq.  (48).  Here,  the  gain  K?c  =  K^,  as  for  the 
Butterworth  approximation,  but  the  gain  is 

K1C  -  <Krl  -  Kr3)KS  <54 

where  is  a  scale  factor  such  that  the  Chebyshev  ripple  in  Figs.  9(a), 
9(b),  and  9(c)  is  centered  about  a  gain  of  1  (instead  of  having  its  maxima 
at  1) .  It  is  easy  to  show  that 

.  2£Lili>  (55 

2  +  r 

C.  Worst-Case  Performance  Evaluation 


As  for  the  e-contaminated  class,  we  will  look  at  the  worst-case  perform¬ 
ance  of  the  nominal  filter  and  the  ideal  and  approximate  robust  filters  by 
evaluating  the  worst-case  output  SNR  as  given  by  Eq.  (43. b)  (with  the 

e-contaminated  classes  J ^  and  71 £  replaced  by  the  p-point  classes  tf  and  71^) 

2 

Therefore,  we  would  like  to  derive  expressions  for  sup  e(S,N,H)/vc 

(S,N)  e  J  x  71 

for  the  different  filters  considered.  v 

Since  the  only  knowledge  about  the  PSD's  S(w)  and  N(w)  in  the  p-point 
class  is  their  total  and  fractional  powers,  we  can  use  this  information  to 
obtain  an  upper  bound  on  the  MSE.  To  do  this,  the  integral  in  the  MSE  expres¬ 
sion,  as  given  by  Eq.  (1),  is  broken  up  into  the  three  intervals  [b^,  b^) , 

[b,  ,  bn),  and  (b0,  b,,)  where  bn  =  0,  b,  =  1-a,  b?  =  1+a,  and  b-^  =  i.e.  , 


e (S  ,N,H)  =  —  Z  Jj  [  S(u>)  |l-H(u)  |  +  N(u)  |H(oj)  |  ]  du 

’Jsl  Vi 
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*  Z  I pc i  vq  max  |l-H(w)|2  +  pH.  v2  max  |H(m)|2 

j=l  1  3  U)  e  i.  NJ  N  0)  e  I. 
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where 


V'Yi-V'  <5 

The  last  step  is  true  from  the  definition  of  the  p-point  spectral  classes 
(see  Eqs.  (44. a),  (44. b)). 

In  fact,  the  bound  in  (56)  is  the  least  upper  bound  on  e(S,N,H).  The 
fore,  the  worst-case  performance  for  H  is 


sup  e(S,N,H)  =  Z  (p  v2  max  |l-H(w)|2  +  p  v2  max  |H(u>) 

S  X  n  ]-l  l  Sj  S  0)  €  I.  N3  N  0)  €  I. 

P  P  J  2 


Note  that  the  fractions  p  and  p  can  be  found  from  (see  Eqs.  (44. a)  and 

Sj  Nj 

(44. b)) 


,  D  . 

x  =  — o  I  J  S_ (w)dw 
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— j  J  J  Nq  (oj) dco 

tv.,  b.  1 
N  j-1 

2  r  -i  bj  .  -i  bi-i 

*  L  **  aN 


,  j=l,2,3 


(59. b) 


where  Sq(u>)  and  (oj)  are  the  nominal  densities  (given  by  Eqs.  (4. a)  and 
(4.b))  which  we  assume  to  be  the  true  spectra. 


1 .  Nominal  filter 

k 

Since  the  nominal  filter  (to)  given  by  Eq .  (5)  is  a  real,  continuous, 

k 

monotone  decreasing  function  of  m  and  0  <  H_(id)  <_  1,  we  have 


“MbH'V 


1  Vi’V 


]H*(u)|2  -  [hJu  -  bj_1)]2,  j-1,2,3 


1-H*(a,)j2  -  [  -  bj  )J  2,  j-1,2,3 


(60. a) 


(60. b) 


where  =  0,  b^  =  1-a,  b£  =  1+a,  and  =  +°°.  The  above  maxima  can  easily 
be  computed  using  Eq.  (5)  and  then  substituted  in  Eq.  (58).  The  results  for 
the  special  case  a=0  can  be  found  in  Vastola  [3]  and  show  that  the  perform- 

k 

ance  of  the  nominal  filter  is  unacceptable  since  it  is  significantly 
worse  than  trivial  filtering. 

2 .  Ideal  robust  filter 

For  the  ideal  robust  filter  HR  considered  (see  Fig.  6  and  Eq.  (45)),  it 
is  easy  to  show  (using  Eq.  (58))  that 
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sup  e(S,N,HR) 

j  x  n 


j=l  PS3r  + 


where  the  fractions  p„.  and  p., .  are  given  in  Eqs.  (59. a)  and  (59. b). 

Sj  Nj 

3.  Approximate  robust  filter  with  Butterworth  approximation 
Using  Eq.  (58)  for  the  approximate  robust  filter  Hn(w)  given  by  Eq.  (52) 
for  the  Butterworth  case,  we  have 


sup  e(S,N,Hn) 

J  x7l 


max  H  (to) 
n 

co  G  I. 


5  p  max  |l-H(o))|  +  p„, 

j  =  l  co  €  I.  n 

J  3 


with  1^  =  [0,  1-a) ,  I2  =  [  1-a,  1+a),  and  =  [  1+a,  ») .  The  optimal  value 
of  the  parameter  a,  0  £  a  <_  0.4,  is  determined  for  each  order  n,  as  dis¬ 
cussed  in  Appendix  B.  Since  the  Butterworth  magnitude  squared  response 
|Hgn(u))|  is  a  real,  monotone  decreasing  function  of  to,  and  the  gains 
of  the  ideal  robust  filter  are  such  that  0  <  <  1,  the  maxima  in  Eq.  (62) 

are  easily  evaluated,  i.e. , 


max  |H  (to)  r  =  (H  (u>  =  b  ,))Z,  j-1,2,: 

£  l  n  J 


max  i  1-H  (co)  |  =  (1-H  (to  =  b.))  ,  j-1,2, 3 

to  €  I.  J 


(63. a) 


(63. b) 


As  for  the  e-contaminated  class,  we  have  presented  the  numerical  results  in 

terms  of  worst-case  output  SNR  versus  input  SNR,  both  expressed  in  dB  (see 

,  9 

Eqs.  (43. a)  and  (43. b)).  The  ratio  sup  e(S,N,H)/v  is  given  bv  Eqs.  (61) 

SD*7l  b 

r  D 

and  (62)  for  the  ideal  robust  filter  H  and  the  approximate  robust  filter 


Hn>  respectively.  As  is  shown  in  Appendix  B,  we  will  use  a  value  of  a=0  for 

the  ideal  robust  filter  because  its  performance  is  relatively  insensitive 

to  variations  of  the  parameter  a,  and  the  optimal  value  of  a  corresponding 

to  each  approximate  robust  filter  Hn>  n=2,3, . . . ,10.  In  our  numerical  results 

for  the  p-point  class,  we  have  taken  the  nominal  signal  and  noise  bandwidths 

to  be  a^  =  1  and  a^  =  10,  respectively. 

Figure  10  illustrates  the  worst-case  performances  of  the  ideal  robust 

filter  H  and  of  the  approximate  robust  filter  H  using  the  Butterworth 
K  n 

approximation.  We  observe  that,  as  the  order  n  increases,  the  worst-case 

performance  of  the  approximate  robust  filters  gradually  approaches  that 

of  the  ideal  robust  filter  HR.  The  tenth  order  filter  gives  a  fairly  good 

approximation  of  HR  (less  Xhan  0.7  dB  difference),  while  the  second  order 

filter  does  generally  better  than  triv: al  filtering  except  for  small  SNR's 

where  it  does  slightly  worse.  In  general,  we  see  that  for  orders  n  >_  4, 

the  approximation  is  adequate.  The  improvement  in  performance  for  higher 

orders  n  is  to  be  expected,  of  course,  since  the  response  of  the  approximate 

robust  filter  H  (oo)  becomes  closer  to  that  of  the  ideal  robust  filter  H  (to) 
n  K 

as  n  increases. 


4 .  Approximate  robust  filter  with  Chebyshev  approximation 

The  worst-case  performance  of  the  approximate  robust  filter  using  the 
Chebyshev  filters  is  still  given  by  Eq.  (62)  but  with  Hn(to)  of  Eq.  (53). 

In  this  case,  the  optimal  value  of  the  parameter  a  is  determined  for  each 
order  n  and  each  value  of  the  ripple  y  considered  (see  Appendix  B,  Table  3). 
Furthermore,  the  maxima  in  Eq.  (62)  depend  on  the  locations  of  the  maxima 
of  the  ripple  of  the  Chebyshev  filters  relative  to  (1-a)  (see  Figs.  9(a), 


Point  class.  Butterworth  approximation.  (From  top  to  bottom)  Worst-case  performances  of 
eal  robust  filter  Hp,  approximate  robust  filters  H_ ,  n=10,  6,  4,  2,  and  trivial  filtering. 
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(b),  and  (c))  and  on  the  gains  of  the  ideal  robust  filter.  It  can  be  shown 
that  these  maxima  are 


w  €  [  0,  1-a) 


H  (u) 


(K1C  +  K2C>' 


if  1-a  >  w  (n,  k  ) 
max  max 


H  (oo)  if  1-a  <  oo  (n,  k  ) 

n  ,  —  max  max 

oo  =  1-a 


where 


oo  (n,k)  =  cos 
max 


(  (2k  +  1)A 

V  2n  r 


k  =  0,1, ...  ,k 


with  k 


~2  -  1,  n  even 

— 

max  n-1 

— 2~  »  n  odd 


are  the  locations  of  the  maxima  of  the  n-th  order  Chebyshev  response  (i.e., 
the  values  of  the  frequency  oo  for  which  the  ripple  y  of  the  magnitude  squared 

2 

response  of  Chebyshev  filters  |H_  (oo)  ]  is  at  its  maximum).  In  addition, 


we  have 


oo  €  [  1-a,  1+a) 


jH  (go) 


(K.r  +  K„r)  if  1-a  <  o)  (n,0) 
1C  2C  max 


H  (cd)  xf  1-a  >  a)  (n,0) 

n  —  max 

co  =  1-a 


Max  lH  (oo)  | 2  =  |H  (oo)  |2 
00  e  [  l+a,  =°)  0)  =  1+a 


We  note  that  wmax^n»0)  anc*  ^max^’^max^  are  ’  resPectively ,  the  largest  and 

smallest  values  of  u>  (0  co  <  1)  for  which  H_  (oo)  I  reaches  its  maximum 

Cn 

(see  Eqs .  (48),  (49)  ,  and  Figs.  9(a)-(c)). 
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Similarly,  we  have 


Max  j  1“H  (oj)  |  2  =  (1 - -  K._)2 

u  €  [  0,  1-a)  1  +  6  ^ 


(68) 


Max 

u  €  [  1-a,  1+a) 


|l-Hn(o))|2  =  1 1-Hn(oo)  |  2 


(69) 


u  =  1+a 


and 


Max 

[  1+a. 


|l-Hn(w) 


-  Il-Hn(a>) 


w  —  +°° 


=  (1  -  K2C)2  (70) 

2  ^1C  2 

We  observe  that  (K^  +  K2C)  and  (1  -  -  K^)  are  the  maximum  values 

2  2 

of  the  ripples  of  | Hn (to)  |  and  |l-Hn(w)|  .respectively. 

Substituting  Eqs.  (64)-(70)  in  Eq.  (62)  for  the  approximate  robust 
filter  Hn(oj)  with  the  Chebyshev  approximation  and  using  the  optimal  value 
of  a  for  each  order  n  and  each  ripple  y,  we  can  obtain  the  worst-case  output 
SNR’s  (as  given  by  Eq.  (43. b)  for  the  p-point  classes  and  7^)  for  the 
filters  Hn(w),  n=2,3, . . . ,10,  and  ripples  y  *  0.5,  1,  2, and  3  dB.  Figures 
11(a),  (b),  (c),and  (d)  illustrate  the  worst-case  performances  of  the  approxi¬ 
mate  robust  filters  Hn(w)  for  values  of  the  ripple  y  =  0.5,  1,  2, and  3  dB 
respectively,  compared  to  the  worst-case  performance  of  the  ideal  robust 
filter  H^,  and  trivial  filtering.  We  observe  that,  for  a  fixed  value  of  the 
ripple  y,  performance  improves  with  increased  order  n.  This  is  to  be  expected 
since,  for  a  given  ripple  y,  as  the  order  n  increases,  the  rolloff  of  |HCn(w) | 
in  the  stopband  is  steeper  (see  Figs.  9(a),  (b),and  (c)),  and  therefore  the 
approximate  robust  filter's  response  is  closer  to  that  of  the  ideal  robust 


10.0 


Figure  11(a).  p-Point  class.  Chebyshev  approximation  (Fixed  ripple  Y=0.5dB)*  (From  top  to  bottom)  Worst-case 
performances  of  ideal  robust  filter  H  ,  and  approximate  robust  filters  H  ,  n=10,  5,  3,  and  2. 


lass.  Chebyshev  approximation  ( y =ldB) .  (From  top  to  bottom)  Worst-case  performance 
robust  filter  H  ,  and  approximate  robust  filters  H  ,  n=10,  5,  3,  and  2. 
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Point  class.  Chebyshev  approximation  (y  =3dB).(From  top  to  bottom)  Worst-case  performances 
ideal  robust  filter  H„,  and  approximate  robust  filters  H  ,  n=10,  5,  3,  and  2. 
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filter.  In  comparing  Figs.  11(a),  (b) ,  (c) ,  and  (d) ,  we  see  that,  except 
for  very  small  orders  (n=2  and  3),  the  filters  (oj)  with  the  smaller  ripple 
(y  =  0.5  dB)  have  the  best  performance.  For  the  second  and  third  order  fil¬ 
ters,  there  is  an  improvement  in  performance  with  increased  ripple.  To  get  more 
insight  on  the  effect  of  the  ripple  on  performance,  we  have  compared  the 
worst-case  output  SNR  for  (oo)  with  different  values  of  the  ripple,  when 
the  order  n  is  fixed.  Figures  12(a),  (b) ,  (c),  (d) ,  and  (e)  illustrate  the 
worst-case  performances  of  the  approximate  robust  filter  Hn(w)  for  n  =  2, 

3,  5,  7,  and  10,  respectively,  and  several  values  of  the  ripple  y  (0.1  dB  <_ 

Y  1  3  dB) . 

In  Figure  12(a)  (ns=2)  ,  we  see  that,  for  such  a  small  order  n,  the 
improvement  in  performance  due  to  a  steeper  rolloff  in  the  stopband,  as  the 
ripple  y  is  increased,  is  greater  than  the  deterioration  in  performance  due 
to  a  larger  value  of  the  peak  of  the  ripple  in  the  passband  (see  Figs.  9(a), 
(b),  and(c)).  Thus,  the  general  effect,  in  this  case,  is  that  increasing  the 
ripple  improves  worst-case  performance.  The  only  exception  to  this  is  that 
performance  for  y  =  3  dB  (which  is  not  shown)  is  slightly  worse  than  for 

Y  *  2  dB,  because  the  difference  in  rolloff  between  the  two  ripples  is 
smaller  than  the  difference  in  the  maximum  of  the  ripple.  Results  for 

Y  =  0.1  dB  are  not  shown  but  are  much  worse  than  for  y  =  0.5  dB,  due  to  the 
compounded  effect  of  a  small  ripple  and  a  small  order  n,  both  leading  to  a 
very  gradual  rolloff. 

In  Figure  12(b)  (n=3) ,  the  tradeoff  between  increasing  the  ripple  to 
get  a  more  abrupt  rolloff  in  the  stopband  and  decreasing  the  ripple  to 
lower  the  maximum  value  of  its  peak  in  the  passband,  is  more  apparent. 


12(a).  P-Point  class.  Chebyshev  approximation  (Fixed  order  n  =  2).  (From  top  to  bottom)  Worst-i 
performances  of  ideal  robust  filter  H  and  approximate  robust  filters  H„  for  ripples  y 


nt  class.  Chebyshev  approximation  (n= 3).  (From  top  to  bottom)  Worst-case  performances 
eal  robust  filter  H  and  approximate  robust  filters  11  for  y=l ,  3,  and  0.1  dB. 


nt  class.  Chebyshev  approximation  (n=5).  (From  top  to  bottom)  Worst-case  performances 
leal  robust  filter  Hp  and  approximate  robust  filters  H.  for  Y=0.5,  2,  and  3  dB. 
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lass.  Chebyshev  approximation  (n=10).  (From  top  to  bottom)  Worst-case  performances 
robust  filter  H  and  approximate  robust  filter  Hi0  for  y~0.1,  1,  2,  and  3  dB. 


Performance  for  y=2  and  0.5  dB  (both  not  shown)  is  almost  the  same  and 
falls  between  the  y=l  and  3  dB  curves. 

In  Figure  12(c)  (n=5),  we  observe  that,  in  general,  the  results  are 
substantially  better  than  for  n=2  and  3.  Furthermore,  since  the  rolloff  in 
the  stopband  is  already  much  steeper  because  of  the  higher  order,  a  larger 
ripple  for  the  filters  Hn(u))  contributes  more  to  a  degradation  in  perform¬ 
ance  due  to  the  large  peak  in  the  passband  than  to  an  improvement  due  to 
the  steeper  rolloff  in  the  stopband.  The  reason  for  this  is  that,  as  seen 
in  Figs.  9(a),  (b) ,  and  (c) ,  as  the  order  n  increases,  the  improvement  in 
rolloff  due  to  a  larger  ripple  decreases.  We  note  that  the  best  performance 
is  obtained  for  y  =  0.5  dB,  followed  very  closely  by  y  =  1  dB  (not  shown). 
Performance  for  the  smallest  ripple  considered,  y  =  0.1  dB,  is  not  shown,  but 
our  results  indicate  that  it  is  between  the  y=l  and  2  dB  curves  towards  the 
negative  input  SNR's  (in  dB) ,  then  almost  coincides  with  the  3  dB  curve 
towards  positive  SNR's  (in  dB) .  This  effect  indicates  that  the  improvement 
in  rolloff  due  to  an  increased  ripple  is  more  pronounced  for  positive  input 
SNR's.  Indeed,  this  is  the  case,  since,  if  we  look  at  the  term 

p  max  |Hn(u)|2/r  (71) 

J  w  €  I. 

3 

in  Eq.  (62),  we  observe  that  the  interval  1^  over  which  this  term  has  the 
greatest  contribution  is  I^  =  [1+a,  ®)  because  the  noise  has  a  3  dB  band¬ 
width  at  co=10,  and  thus  the  largest  fraction  of  its  power  is  p  ^  (in  the 

interval  I^).  From  Equation  (67),  it  is  clear  that  this  maximum  reflects 

2 

the  effect  of  the  rolloff  of  |Hn(u>)  |  in  the  stopband.  For  positive  input 
SNR's  (in  dB),  i.e.,  r>l,  since  the  maximum  is  divided  by  r,  the  term  in 


(71)  is  further  decreased,  leading  to  better  performance. 

Finally  for  n  >_  7  (see  Figs.  12(d)  and  (e)  for  n=7  and  10, respectively) , 
performance  improves  with  decreasing  ripple  with  the  best  performance  obtained 
for  ripples  y  =  0.5  or  0.1  dB.  For  high  orders  n,  the  predominant  effect  is 
the  peak  value  of  the  ripple  in  the  passband,  because  the  rolloff  is  already 
abrupt  and  the  improvement  in  rolloff  due  to  an  increased  ripple  is  relatively 
small. 

By  plotting  figures  similar  to  Figures  12(a)-(e)  for  all  n  (n=2,3, . . .  ,10) 
it  is  possible  to  find  for  each  n,  the  value  of  the  ripple  that  gives  the  best 
performance  for  this  filter  and  the  one  that  gives  the  worst  performance. 
These  values  are  shown  in  Table  1.  From  these  results,  we  conclude  that  rip¬ 
ples  y  larger  than  2  dB  or  smaller  than  0.1  dB  should  not  be  considered,  since 
the  3  dB  ripple  yields  the  worst  performances  for  all  n  except  2  and  3,  and 
the  0.1  dB  ripple  has  good  performances  only  for  orders  n  >_  7  and  the  worst 
performances  for  n=2  and  3.  In  addition,  we  observe  that  the  larger  values  of 
the  ripple  (y  =  2  and  1  dB)  yield  the  best  performance  for  small  orders  n, 
while  small  values  of  the  ripple  (y  =  0.1  and  0.5  dB)  yield  the  best  perform¬ 
ance  for  large  orders  n.  Again,  this  reflects  the  fact  that  for  small  n 
the  improvement  gained  from  a  steeper  folloff  in  the  stopband  due  to  a  larger 
ripple  is  greater  than  the  deterioration  from  a  larger  maximum  of  the  ripple 
in  the  passband.  For  large  n,  the  opposite  is  true. 

5 .  Comparison  of  the  Butterworth  and  Chebyshev  approximations 
and  conclusions 

In  order  to  compare  the  performances  of  the  approximate  robust  filters 
using  the  Butterworth  or  Chebyshev  approximations,  we  have  shown,  in  Fig.  13, 
the  worst-case  performance  of  the  approximate  robust  filter  with  the 
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TABLE  1 

VALUES  OF  THE  RIPPLE  y  (IN  dB)  THAT  GIVE  THE  BEST  AND 
WORST  PERFORMANCE  FOR  EACH  APPROXIMATE  ROBUST  FILTER 
H^w)  (USING  THE  CHEBYSHEV  APPROXIMATION)  FOR  THE 
p-POINT  CLASS 


Best  ripple  (dB) 


Worst  ripple  (dB) 


2 

1 

0.5,  1 


0.5 

(1  slightly  worse) 

6  |  0.5 

7  |  0.5 

(0.1  slightly  worse) 

8  |  0.5 

(0.1  slightly  worse) 

9  |  0.5,  0.1 

10  |  0.1 

(0.5  slightly  worse) 


0.1 

0.1 


3  (input  snr  <  -3dB) 
0.1  (input  snr  >  -3  dB) 


3 

3 


\>N\\\ 
\v\\\  \ 

\v\\v 

\  'A  V\ 


>\\\  \ 
\\\\\ 
\W\\X 
\v\W 


\\\Yi 

\\\\\  \ 

\w\\ ' 

\\U  1 

m 

\i  \  * 

i 

•a 


l  <M 

(9P)  HNS  3nd3no 


p-Point  class.  Chebyshev  approximation.  (From  top  to  bottom)  Worst-case  performances  of  ideal 
robust  filter  H  and  approximate  robust  filters  H  ,  n=10,6,4,3,  and  2  with  the  optimal  values  o 
the  ripple  y  fo£  each  n  (as  given  in  Table  1). 


Chebyshev  approximation  and  the  value  of  the  ripple  y  that  gives  the  best 

performance  for  each  order  n  (see  Table  1).  From  Figs.  10  and  13,  it  is 

clear  that,  except  for  n=4  where  both  approximations  yield  about  the  same 

results,  the  Chebyshev  approximation  gives  better  performance  than  the 

Butterworth  approximation  for  n  >_  5  and  vice  versa  for  n=2  and  3.  The 

justification  for  these  results  is  that,  for  n  >_  5,  the  Chebyshev  response 

has  substantially  larger  attenuations  near  the  cutoff  frequency  uc  =  1  in 

the  stopband  than  the  Butterworth  response  (see  Figs.  2,  9(a)-(c)).  However, 

for  n=2  and  3,  although  the  Chebyshev  response  is  in  general  steeper  than  the 

Butterworth  response,  the  attenuation  near  uc  =  1  in  the  stopband  is  greater 

2 

for  the  Butterworth  response  |Hgn(m) |  because  at  wc  =*  1  the  Butterworth 
response  has  dropped  to  a  lowet  value  than  the  Chebyshev  response. 

The  general  conclusion  that  can  be  drawn  for  the  p-point  class  is  that 
for  orders  n  5,  the  approximate  robust  filters  using  the  Chebyshev  approxi¬ 
mation  and  the  corresponding  optimal  value  of  y  for  each  n,  have  a  worst-case 
performance  that  is  sufficiently  close  to  that  of  the  ideal  robust  filter  HR, 
particularly  for  the  higher  orders  n  (less  than  0.7  dB  difference  for  n=7  and 
less  than  0.4  dB  difference  for  n=10) .  For  orders  n  =  2,  3,and  4,  the 
Butterworth  approximation  yields  better  results  (or  equal  for  n=*4)  than  the 
Chebyshev  approximation.  These  filters  with  small  orders  n  have  a  worst- 
case  performance  that  is  better  than  trivial  filtering  except  for  a  small 

portion  of  the  negative  input  SNR  axis.  Thus,  in  the  worst-case  they  have 

* 

even  better  performance  than  the  nominal  filter  Hn. 


IV.  SUMMARY  AND  CONCLUSIONS 

In  this  study,  we  have  approximated  the  ideal  robust  Wiener  filters  for 
both  the  e-contaminated  and  the  p-point  uncertainty  classes  of  spectra  with 
realizable  n-th  order  filters  of  the  Butterworth  and  Chebyshev  types.  The 
worst-case  performance  of  the  approximate  robust  filters  was  compared  to 
that  of  the  corresponding  ideal  robust  filter. 

In  the  e-contaminated  class  the  uncertainty  is  modeled  in  terms  of 
contaminating  densities  which  modify  to  a  certain  degree  the  nominal  densities 
of  the  signal  and  noise.  For  this  class  we  have  shown  that  the  approximate 
robust  filter  using  only  second  order  Butterworth  low-pass  filters  gives  a 
very  good  approximation  to  the  ideal  robust  filter  for  that  class,  for  both 
degrees  of  uncertainty  considered  (less  than  0.2  dB  difference). 

In  the  p-point  class  the  only  knowledge  of  the  PSD's  of  the  true  signal 
and  noise  is  their  total  and  fractional  powers.  Here  we  have  considered  two 
approximations,  using  either  Butterworth  or  Chebyshev  filters.  The 
Butterworth  approximate  robust  filters  have  a  worst-case  performance  which 
gradually  approaches  that  of  the  ideal  robust  filter  with  increasing  order  n 
(within  0.7  dB  for  n  =  10).  The  Chebyshev  approximate  robust  filters  also  have 
a  worst-case  performance  which  improves  with  increasing  order  n,  for  a  given 
ripple  y.  In  addition,  we  observed  that  there  is  a  tradeoff  between  increasing 
the  ripple  of  the  Chebyshev  filters  to  improve  the  rolloff  in  the  stopband 
and  decreasing  the  ripple  to  decrease  its  maximum  value  in  the  passband.  For 
different  orders  n,  one  or  the  other  of  these  two  effects  Is  predominant.  The 
result  is  that  the  best  approximation  is  obtained  for  high  orders  n  (n  >_  7) 
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and  small  ripple  (y  =  0.5  or  0.1  dB).  We  have  also  shown  that  the  Chebyshev 
approximate  robust  filters  have  better  performance  than  the  Butterworth 
approximate  robust  filters  for  higher  orders  n  (n  ^  5)  and  vice  versa  for 
orders  n  =  2,  3,  and  4.  Therefore,  for  the  p-point  class  we  conclude  that 
the  approximate  robust  filters  using  Chebyshev  filters  of  high  order  and 
small  ripple  yield  the  best  approximation  to  the  ideal  robust  filter  (within 
0.4  dB  for  n  =  10  and  y  =  0.1  dB) . 

Finally,  in  comparing  the  two  uncertainty  classes  of  spectra  considered, 
we  note  that  better  results  have  been  obtained  for  the  e-contaminated  class 
than  for  the  p-point  class.  The  reason  for  this  is  that  there  is  more 
uncertainty  in  the  knowledge  of  the  true  spectra  of  the  signal  and  noise  in 
the  p-point  class  than  in  the  e-contaminated  class.  . 


APPENDIX  A 


IMPLEMENTATION  OF  THE  MAGNITUDE  SQUARED  RESPONSE  |H(jo))|2  OF  A 
CAUSAL  FILTER  H(jw)  BY  SIGNAL  PROCESSING  TECHNIQUES 

Given  a  causal  filter  H(jm)  with  impulse  response  h(t),  we  know,  from 

the  algebra  of  complex  numbers,  that  its  magnitude  squared  response  can  be 

written  <*s 

| H ( j uj)  |  2  =  H(jw)  *H*( jcu)  (7 

* 

where  H  (jw)  denotes  the  complex  conjugate  of  H(joj).  On  the  other  hand,  we 
know  from  the  properties  of  Fourier  transforms  that 

?"1[H*(jo>)]  =  h(-t)  (7 

where  5  [H(jw)]  denotes  the  inverse  Fourier  transform  of  H(ju>).  Thus, 

using  the  time  convolution  property  of  Fourier  transforms,  we  have 

1  *  00 

?  [HCjuO-H  (ju)]  =  h(t)  *  h(t)  =  /  h(t-T)h(r)dT  (7. 

—  00 

where 

h(t)  £  h(-t)  (7. 

2 

The  problem  of  implementing  |H(ju))|  is  then  equivalent  to  the  time 
domain  convolution  of  h(t)  with  h(t),  as  shown  in  Fig.  14.  Thus,  if  z(t) 
is  the  desired  output  and  y(t)  is  the  input,  we  have 

z(t)  *  h(t)  *  h(t)  *  y (t) 

-  (h  *  y)  (t)  *  h(t)  (7i 

Defining 

x(a)  *  (h  *  y) (a) 

00 

*  /  h(a-T)y(T)dx 


(7 


(since  h(o-x)  =  0  for  x  >  c  from  the  causality  of  h(t)),  Eq*(76)  becomes 


z(t)  =  /  h(t-a)x(a)da 


=  /  h(t-a)x(a)da 

(since  h(t-a)  =  0  for  a  <  t) .  Using  Eq*  (75),  we  obtain 

CO 

z(t)  =  /  h(o-t)x(a)do. 
t 

With  the  change  of  variables  o'  =  -a,  the  integral  in  (79)  becomes 

-t 

z(t)  =  j  h(-a'-t)x(-a,)da' 

—CO 

Therefore, 

t 

z(-t)  =  J  h(t-a' )x(-a' )da' 

—CO 


(78; 


(79: 


(80) 


(81) 


From  the  definition  of  the  convolution  integral  and  the  causality  of  h(t). 
the  right-hand  side  of  Eq.  (81)  is  simply  the  convolution  of  h(t)  with  x(-t), 
i.e.  , 


z(-t)  =  h(t)  *  x(-t)  (82) 

Using  Eqs.  (77)  and  (82),  we  can  obtain  an  implementation  of  the  convolution 

in  Eq.  (76)  by  signal  processing  techniques,  as  shown  in  Fig.  15,  where  we 

assume  that  the  data  such  as  x(t)  or  z(-t)  are  stored  on  tape  so  that  x(-t) 

and  z(t)  can  be  obtained  by  simply  reversing  the  corresponding  tape.  In 

2 

this  way,  we  have  shown  that  it  is  possible  to  implement  |H(jw)| 

(although  not  in  real  time). 


APPENDIX  B 


ROLE  OF  THE  PARAMETER  a  IN  THE  PARTICULAR  p-POINT 
CLASS  CONSIDERED  AND  OPTIMAL  CHOICE  OF  a 

The  purpose  of  this  appendix  is  to  justify  the  introduction  of  a  small 
interval  [l-a,l+a]  around  the  breakpoint  =  1  in  the  p-point  nlass  used  by 
Vastola  [3]  as  described  in  Chapter  III,  Section  B.l  (with  m  =  2,  b^  =  0, 
b^  =  l,and  b^  =  +°°)  ,  and  to  show  how  the  parameter  a  was  chosen  optimally  for 
each  approximate  robust  filter  considered. 

The  modified  p-point  class  has  three  regions  (m  =  3)  with  the  breakpoints 
bg  =  0,  b  =  1-a,  b^  =  l+a,and  b^  =  +«>.  The  expression  for  the  worst-case 

MSE  for  this  class  is  given  by  Eq.  (58).  For  the  p-point  class  considered  by 

Vastola  [3],  the  expression  is  the  same  except  that  the  limit  of  the  summation 

is  2  instead  of  3.  From  Eqs.  (52)  and  (53),  and  Figs.  2,  9(a)  -  9(c),  we 

observe  that  the  responses  of  the  approximate  robust  filters  (with  the 
Butterworth  approximation  or  the  Chebyshev  approximation  for  a  given  ripple  y) 
have  the  same  value  at  u  =  1  for  all  orders  n.  Thus,  it  is  clear  that  the 
maxima  in  Eq.  (58)  (for  the  p-point  class  considered  by  Vastola  [3])  will  be 
the  same  for  all  orders  n  of  the  Butterworth  approximate  robust  filters  or  of 
the  Chebyshev  approximate  robust  filters  with  a  given  ripple  y.  Therefore, 
by  using  the  m  *  2  p-point  class  with  the  breakpoint  b^  =  1,  we  are  not  able 
to  distinguish  the  improvement  in  worst-case  performance  when  the  order  of  the 
approximate  robust  filters  is  increased.  This  observation  led  us  to  introduce 
a  small  interval  [l-a,l+a]  around  w  =  1  and  choose  the  parameter  a  in  an 


optimal  way. 
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Since  the  desired  intermediate  region  is  to  be  small,  we  confined  a  to 
lie  in  the  interval  [0,0.4].  The  procedure  for  choosing  the  optimal  value  of 
the  parameter  a  is  the  following:  for  a  fixed  input  SNR  and  for  each 
approximate  robust  filter,  the  output  SNR  is  computed  for  all  values  of  a, 

0  _<  a  _<  0.4.  The  value  of  a  which  yields  the  maximum  output  SNR  is  chosen  to 
be  the  optimal  value  of  a  for  the  particular  approximate  robust  filter 
considered. 

By  fixing  the  input  SNR  at  several  values  and  repeating  the  above  procedure, 
we  found  that  the  optimal  values  of  a  are  relatively  insensitive  to  changes  in 
input  SNR.  Thus,  in  our  numerical  results,  we  fixed  the  input  SNR  at  0  dB. 

For  the  approximate  robust  filters  using  the  Butterworth  approximation,  we 

repeat  the  above  procedure  for  each  order  n.  Figure  16  shows  the  variations 

of  the  worst-case  output  SNR  with  the  parameter  a,  for  the  ideal  robust  filter 

H  , and  the  approximate  robust  filters  H  using  the  Butterworth  approximation 
R  n 

for  several  orders  n  (with  the  input  SNR  fixed  at  0  dB) .  We  observe  that,  for 

small  orders  n,  a  larger  value  of  a  yields  better  performance  because  the 

rolloff  of  the  filters  with  small  n  is  very  gradual.  As  n  increases,  a  smaller 

value  of  a  is  optimal.  We  also  note  that  the  ideal  robust  filter's  worst- 

case  output  SNR  is  relatively  insensitive  to  variations  in  the  parameter  a. 

Therefore,  in  our  numerical  results,  we  have  used  a  value  of  a  =  0  for  the 

ideal  robust  filter.  Table  2  shows  the  optimal  values  of  a  for  each  approximate 

robust  filter  H  using  the  Butterworth  approximation, 
n 

For  the  approximate  robust  filters  using  the  Chebyshev  approximation, 
we  have  to  choose  the  optimal  value  of  a  (as  described  above)  for  each  order 
n  and  each  ripple  y.  Figures  17(a),  (b),  and  (c)  show  the  variations  of  the 
worst-case  output  SNR  with  the  parameter  a,  for  the  approximate  robust  filters 


n 


Optimal  a 


2 

3 

4 

5 

6 

7 

8 
9 

10 


0.40 

0.33 

0.29 

0.26 

0.24 

0.22 

0.20 

0.19 

0.17 


re  17(a).  P-Point  class.  Chebyshev  approximation  (y  =  0.5  dB) .  (From  top  to  bottom)  Worst-case 
output  SNR  versus  a  (fixed  input  SNR  =  0  dB)  for  the  ideal  robust  filter  H  and  the 
approximate  robust  filters  H  ,  n=  10,  6,  4,  3,  and  2. 


6 


(9P)  HNS  ^nd^no 


gure  17(b).  P-Point  class.  Chebyshev  approximation  (y  =  1  dB).  (From  top  to  bottom)  Worst-ca: 

output  SNR  versus  a  (fixed  input  SNR  =  0  dB)  for  the  ideal  robust  filter  and  the 
approximate  robust  filters  H  ,  n  =  10,  6,  4,  3,  and  2. 


with  the  Chebyshev  approximation,  and  for  ripples  y  =  0.5,  1  and  2  dB, 
respectively.  In  general,  the  optimal  value  of  a  is  smaller  for  larger  n  and 
larger  ripple  y.  Table  3  shows  the  optimal  values  of  a  for  the  approximate 
robust  filters  with  the  Chebyshev  approximation,  for  each  order  n  and  each 
ripple  y.  The  optimal  values  of  a  in  Tables  2  and  3  are  the  values  used  in 
the  numerical  results  of  Chapter  III. 
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TABLE  3 


OPTIMAL  VALUES  OF  THE  PARAMETER  a  FOR  THE  APPROXIMATE  ROBUST 

FILTERS  H  WITH  THE  CHEBYSHEV  APPROXIMATION 
n 

(FOR  EACH  ORDER  n  AND  EACH  RIPPLE  y) 


Y(dB) 

0.1 

0.5 

1 

2 

3 

n 

Optimal  a 

2 

0.400 

0.400 

0.400 

0.400 

0.370 

3 

0.400 

0.400 

0.330 

0.265 

0.225 

4 

0.400 

0.280 

0.235 

0.190 

0.165 

5 

0.300 

0.210 

0.175 

0.145 

0.125 

6 

0.235 

0.165 

0.140 

0.115 

0.100 

7 

0.185 

0.135 

0.115 

0.095 

0.080 

8 

0.155 

0.110 

0.095 

0.080 

0.070 

9 

0.130 

0.095 

0.080 

0.065 

0.060 

10 

0.110 

0.080 

0.070 

0.055 

0.050 
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